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(54) Title: EDITING OF DIGITAL VIDEO INFORMATION SIGNALS 



(57) Abstract 

Editing of video information signals recorded on a record carrier, 
such as an optical record carrier (3). The editing is carried out in an 
internal memory of the edit apparatus. Editing results in an edited 
stream of information, which includes a bridging fragment. Prior 
to recording the bridging fragment on the record carrier, the edited 
stream of video information around the edit point is made visible by 
retrieving the edited stream of video information directly from the 
internal memory, so as to shorten the time required to make the edited 
stream of information visible on a display screen. 
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WO 00/04548 
Editing of digital video information signals. 



PCT/EP99/04711 



The invention relates to a method of editing a first and a second digital video 
information signal in an edit apparatus, where the second video information signal may be the 
same video information signal as the first video information signal, the first and second digital 
video information signal being recorded on a record carrier, such as an optical disc, as well as 
5 to an editi apparatus for carrying out the method. Such method is described in European patent 
application no. 98200888.0 (PHN 16815), filed on 19.03.1998 in the name of the same 
applicant. 



10 The above-identified patent application describes how to edit two digital video 

information signals that are recorded a record carrier, such as an optical disc. The video 
information signals are recorded on the record carrier in the form of blocks of information, 
called fragments, having a size of 4 MB, as an example. The invention aims at improving the 
editing method, such that the results of editing become visually available, more quickly. 

15 



The method in accordance with the invention comprises the steps of editing a 
first and a second digital video information signal in an edit apparatus, where the second video 
information signal may be the same video information signal as the first video information 
20 signal, the first and second digital video information signal being recorded on a record carrier, 
such as an optical disc, the method comprising the steps of 

(a) reading a first block of information of the first digital information signal that is located 
around an edit point to be determined in the first digital information signal from the record 
carrier into an internal memory of the apparatus, 
25 (b) outputting the first block of information from the apparatus, for display, 

(c) establishing an 'out' position in the first block of information as the edit point in the first 
digital video information signal, 



WO 00/04548 PCT/EP99/04711 

(d) reading a second block of information of the second digital video information signal that is 
located around an edit point to be determined in the second digital video information signal 
from the record carrier into the internal memory of the apparatus, 

(e) outputting the second block of information of the second digital video information signal 
5 from the apparatus, for display, 

(f) establishing an 'in' position in the second block of information as the edit point in the 
second digital video information signal, 

(g) processing a portion of the first block of information that precedes and may include the 
'out' position, and a portion of the second block of information that follows and may include 

10 the 'in' position into a composite block of information, 

(h) outputting the composite block of information from the apparatus, for display, prior to 

(i) recording at least a portion of the composite block of information on the record carrier. 
More specifically, the step (g) includes the substeps of 

(gl) determining an exit point earlier in the first block of information than the 'out' position, 

15 (g2) determining an entry point later in the second block of information than the 'in' position, 
(g3) creating a bridging block of information from the information in the first block of 
information between the exit point and the 'out' position and from the information in the 
second block of information between the 'in' position and the entry point, the composite block 
of information comprising a portion of the first block of information that directly precedes the 

20 exit point, the bridging block of information and a portion of the second block of information 
that directly follows the entry point. 

The invention is based on the following recognition. The above identified 
patent application describes how editing is performed. More specifically, edit points in the first 
and second digital video information signals are established, those edit points identifying the 

25 positions in the first digital information signal where the first digital information signal is left 
(the so called 'out' position) and where the second digital video information signal is entered 
(the so-called 'in' position). A bridging fragment is created to cover the jump from an earlier 
exit point (earlier than the 'out' position) in the first video information signal to a later entry 
point (later than the 'in' position) in the second video information signal, and the bridging 

30 fragment is recorded on the record carrier. Thereafter, reproduction of the edited video 

information signal from the record carrier can be carried out to investigate the result of the edit 
step. The processing and the subsequent recording of the bridging fragment requires a 
sufficient amount of time, so that the result of the edit operation cannot be directly checked. In 
accordance with the invention, the display of the edited video signal is enabled, directly from 
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the internal memory, that is, prior to recording the bridging block of information on the record 
carrier, by retrieving the bridging fragment and eventually earlier information from the first 
video information signal and later information from the second video information signal, from 
the internal memory. 



These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments hereafter in the figure description, in which 

figure 1 shows an embodiment of the apparatus, 
10 figure 2 shows the recording of blocks of information in fragment areas on the 

record carrier, 

figure 3 shows the principle of playback of a video information signal, 
figure 4 shows the principle of editing of video information signals, 
figure 5 shows a situation during editing, 
15 figure 6 shows an example of the editing of two information signals and the 

generation of a bridging block of information, and 

figure 7 shows a flow diagram of the editing process. 



20 Figure 1 shows an embodiment of the apparatus in accordance with the 

invention. In the the following figure description, the attention will mainly be focussed on 
editing, but prior to discussing editing, the recording and reproduction of a video information 
signal will be described. It should however be noted that other types of signal could equally 
well be processed, such as audio signals, or data signals. 

25 The apparatus comprises an input terminal 1 for receiving a video information 

signal to be recorded on the disc like record carrier 3. Further, the apparatus comprises an 
output terminal 2 for supplying a video information signal reproduced from the record carrier 
3. The record carrier 3 is a disc like record carrier of the magnetic or optical form. 

The data area of the disc like record carrier 3 consists of a contiguous range of 

30 physical sectors, having corresponding sector addresses. This address space is divided into 
fragment areas. A fragment area is a contiguous sequence of sectors, with a fixed length. 
Preferably, this length corresponds to an integer number of ECC-blocks included in the video 
information signal to be recorded. 
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4 

The apparatus shown in figure 1 is shown decomposited into two major system 
parts, namely the disc subsystem 6 and the what is called 'video recorder subsystem' 8. The 
two subsystems are characterized by the following features: 

- The disc subsystem can be addressed transparently in terms of logical addresses. It handles 
5 defect management (involving the mapping of logical addresses onto physical addresses) 

autonomously. 

- For real-time data, the disc subsystem is addressed on a fragment-related basis. For data 
addressed in this manner the disc subsystem can guarantee a maximum sustainable bitrate for 
reading and/or writing. In the case of simultaneous reading and writing, the disc subsystem 

10 handles the read/write scheduling and the associated buffering of stream data from the 
independent read and write channels. 

- The video recorder subsystem takes care of the video application, as well as file system 
management. Hence, the disc subsystem does not interpret any of the data that is recorded in 
the data area of the disc. 

15 In order to realize real time reproduction in all situations, the fragment areas 

introduced earlier need to have a specific size. Also in a situation where simultaneous 
recording and reproduction takes place, reproduction should be uninterrupted. In the present 
example, the fragment size is chosen to satisfy the following requirement: 

20 fragment size = 4 MB = 2 22 bytes 

Recording of a video information signal will briefly be discussed hereafter, with 
reference to figure 2. In the video recorder subsystem, the video information signal, which is a 
real time signal, is converted into a real time file, as shown in figure 2a. A real-time file 

25 consists of a sequence of signal blocks of information recorded in corresponding fragment 
areas. There is no constraint on the location of the fragment areas on the disc and, hence, any 
two consecutive fragment areas comprising portions of information of the information signal 
recorded may be anywhere in the logical address space, as shown in figure 2b. Within each 
fragment area, real-time data is allocated contiguously. Each real-time file represents a single 

30 AV stream. The data of the AV stream is obtained by concatenating the fragment data in the 
order of the file sequence. 

Next, playback of a video information signal recorded on the record carrier will 
be briefly discussed hereafter, with reference to figure 3. Playback of a video information 
signal recorded on the record carrier is controlled by means of a what is called 'playback- 
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control-program' (PBC program). In general, each PBC program defines a (new) playback 
sequence. This is a sequence of fragment areas with, for each fragment area, a specification of 
a data segment that has to be read from that fragment. Reference is made in this respect to 
figure 3, where playback is shown of only a portion of the first three fragment areas in the 
5 sequence of fragment areas in figure 3. A segment may be a complete fragment area, but in 
general it will be just a part of the fragment area. (The latter usually occurs around the 
transition from some part of an original recording to the next part of the same or another 
recording, as a result of editing.) 

Note, that simple linear playback of an original recording can be considered as 

10 a special case of a PBC program: in this case the playback sequence is defined as the sequence 
of fragment areas in the real-time file, where each segment is a complete fragment area except, 
probably, for the segment in the last fragment area of the file. For the fragment areas in a 
playback sequence, there is no constraint on the location of the fragment areas and, hence, any 
two consecutive fragment areas may be anywhere in the logical address space. 

15 Next, editing of one or more video information signals recorded on the record 

carrier will be briefly discussed hereafter, with reference to figure 4. Figure 4 shows two video 
information signals recorded earlier on the record carrier 3, indicated by two sequences of 
fragments named 'file A' and 'file B\ For realizing an edited version of one or more video 
information signals recorded earlier, a new PBC program should be realized for defining the 

20 edited AV sequence. This new PBC program thus defines a new AV sequence obtained by 
concatenating parts from earlier AV recordings in a new order. The parts may be from the 
same recording or from different recordings. In order to play back a PBC program, data from 
various parts of (one or more) real-time files has to be delivered to a decoder. This implies a 
new data stream that is obtained by concatenating parts of the streams represented by each 

25 real-time file. In the figure 4, this is illustrated for a PBC program that uses three parts, one 
from the file A and two from the file B. 

Figure 4 shows that the edited version starts at a point Pi in the fragment area 
f(i-l) in the sequence of fragment areas of figure A and continues until point P 2 in the 
fragment area f(i+l) of file A. Then reproduction jumps over to the point P3 in the fragment 

30 area f(j) in file B and continues until point P 4 in fragment area f(j+2) in file B. Next 

reproduction jumps over to the point P 5 in the same file B, which may be a point earlier in the 
sequence of fragment areas of file B than the point P 3 , or a point later in the sequence than the 
point P 4 . 
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6 

Next, a condition for seamless playback will be discussed. One simple 
condition for this purpose is the constraint on the length of the data segments that occur in the 
playback sequences. In order to guarantee seamless play of a PBC program, the playback 
sequence defined by the PBC program shall be such that the segment length in all fragments 
5 (except the first and the last fragment area) shall satisfy: 

2 MB < segment length < 4 MB 

For a further explanation of this requirement, reference is made to the earlier 
10 filed European patent application no. 98200888.0 (PHN 16815). The use of fragment areas 
allows one to consider worst-case performance requirements in terms of fragment areas and 
segments (the signal blocks stored in the fragment areas) only, as will be described hereafter. 
This is based on the fact that single logical fragments areas, and hence data segments within 
fragment areas, are guaranteed to be physically contiguous on the disc, even after remapping 
15 because of defects. Between fragment areas, however, there is no such guarantee: logically 
consecutive fragment areas may be arbitrarily far away on the disc. As a result of this, the 
analysis of performance requirements concentrates on the following: 

a. For playback, a data stream is considered that is read from a sequence of segments on the 
disc. Each segment is contiguous and has an arbitrary length between 2 MB and 4 MB, but the 

20 segments have arbitrary locations on the disc. 

b. For recording, a data stream is considered that is to be written into a sequence of 4 MB 
fragment areas on the disc. The fragment areas have arbitrary locations on the disc. 

Note that for playback, the segment length is flexible. For record, however, 
complete fragment areas with fixed length are written. 

25 Next, editing will be further described. Creating a new PBC program or editing 

an existing PBC program, generally results in a new playback sequence. It is the objective to 
guarantee that the result is seamlessly playable under all circumstances, even during 
simultaneous recording. A series of examples will be discussed, where it is assumed that the 
intention of the user is to make a new AV stream out of one or two existing AV streams. The 

30 examples will be discussed in terms of two streams A and B, where the intention of the user is 
to make a transition from A to B. This is illustrated in figure 6, where a is the intended exit 
point from stream A and where b is the intended entry point into stream B. 

Figure 5a shows the sequence of fragment areas , f(i-l), f(i), f(i+l), f(i+2), 

.... of the stream A and figure 5b shows the sequence of fragment areas , f(j-l), f(j), f(j+l), 



WO 00/04548 PCT/EP99/04711 

f(j+2), .... of the stream B. The edited video information signal consists of the portion of the 
stream A preceding the exit point a in fragment area f(i+l), and the portion of the stream B 
starting from the entry point b in fragment area f(j). 

This is a general case that covers all cut-and-paste-like editing, including 
5 appending two streams etc. It also covers the special case where A and B are equal. Depending 
on the relative position of a and b, this special case corresponds to PBC effects like skipping 
part of a stream or repeating part of a stream. 

The discussion of the examples given in the earlier filed European patent 
application focuses on achieving seamless playability of the edited stream. The condition for 

10 seamless playability is the segment length condition on the length of the signal blocks of 

information stored in the fragment areas, that was discussed earlier. It is shown in the earlier 
filed European patent application that, if streams A and B satisfy the segment length condition, 
then a new stream can be defined such that it also satisfies the segment length condition. Thus, 
seamlessly playable streams can be edited into new seamlessly playable streams. Since 

15 original recordings are seamlessly playable by construction, this implies that any edited stream 
will be seamlessly playable. As a result, arbitrarily editing earlier edited streams is also 
possible. Therefore streams A and B in the discussion need not be original recordings: they 
can be arbitrary results of earlier virtual editing steps. 

The discussion of various examples in the earlier filed European patent 

20 application results in the conclusion that a seamlessly playable sequence can be defined under 
all circumstances, by creating at most two bridging fragments. It can even be shown that, in 
fact, one bridging fragment area is sufficient. This is shown in figure 6, where, when s and t 
are both very short, they are both copied into a single bridging fragment area (and, if 
necessary, some preceding data from stream A and/or some succeeding data from stream B). 

25 In figure 5a and 5b, the point a in the stream A is defined as the 'out' position, 

where a editor decides where the jump from the signal A to the signal B should start and the 
point b in the stream B is defined as the 'in' position, where the editor decides where the jump 
from the A signal should enter into the B signal. For reasons extensively described in the 
earlier filed European patent application, the position a' in figure 6 generally lies ahead of the 

30 position a in the stream A and the position b' generally lies behind the position b in the stream 
B. In the example of figure 10, the portion s of the fragment f(i+l) and the portions of the 
fragment f(j) are included in the bridging fragment, so that the position a' will lie in the 
fragment f(i) and the position b' will lie in the fragment f(j+l). 
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The method of editing will now further described hereafter with reference to 
figure 7. The editor starts reproducing the stream A, see block 70. This is realized by reading 
the fragments from the record carrier, storing them in an internal memory of the edit 
apparatus, carrying out a decoding process on the information comprised in the fragments and 
5 outputting the decoded video information for display on a TV display tube. The reproduction 
of the stream A is continued until the editor establishes the 'outMocation (the position a), from 
where the jump to the stream B should start, see block 72. This is done by pressing some 
button on the edit apparatus, in response to which pressing, information relating to the position 
a in the stream A is stored in the edit apparatus. Further, a portion of information around the 

10 point a, in any way the portion of the stream A directly preceding the position a, remains 

stored in the internal memory of the edit apparatus, see block 74. Next, the editor instructs the 
edit apparatus to reproduce the stream B, see block 76. This is, again, realized by reading the 
fragments from the record carrier, storing them in the internal memory of the edit apparatus, 
carrying out a decoding process on the information comprised in the fragments and outputting 

15 the decoded video information for display on a TV display tube. The reproduction of the 
stream B is continued until the editor establishes the 'in' location (the position b), to which 
point into the stream B the edit jump should go, see block 78. This is done by pressing the 
above introduced button on the edit apparatus, in response to which pressing, information 
relating to the position b in the stream B is stored in the edit apparatus. Further, a portion of 

20 information around the point b, in any way the portion of the stream B directly following the 
position b, remains stored in the internal memory of the edit apparatus, see block 80. It should 
thus be noted that the internal memory now comprises a portion of information of the stream 
A and a portion of information of the stream B. The portion of information of the stream A 
stored in the internal memory can include the portion s of the fragment f(i+l) or the complete 

25 fragment f(i+l) and eventually the preceding fragment f(i). The portion of information of the 
stream B stored in the internal memory can include the portion t of the fragment f(j) or the 
complete fragment f(j) and eventually the following fragment f(j+l). 

Next, the editing apparatus generates the bridging fragment, see block 82, by 
carrying out a process as described in the earlier filed European patent application, resulting to 

30 the creation of a bridging fragment that is stored in the internal memory as well. This may lead 
to the bridging fragment shown in figure 6, and new exit and entry points a' and b\ Subsequent 
thereto, the edited stream around the edit point is displayed, by outputting the bridging 
fragment from the internal memory, see block 84. The display may be extended to the portion 
of the A stream directly preceding the exit point a', and also stored in the internal memory, 
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and to the portion of the B stream directly following the entry point b\ and also stored in the 
internal memory. 

The editor can decide on whether he is satisfied with the edit process carried 
out, or not, see block 86. When not satisfied, he presses a reject button, see block 88. In 
5 response to pressing the reject button, the apparatus again starts playing the A stream, so as to 
enable the editor to enter new 'out' and 'in' positions, where necessary. When satisfied, the 
editor presses an OK button, see block 90. In response to pressing the OK button, the 
apparatus stores the bridging fragment on the record carrier, including information concerning 
the exit and entry points, so that reproduction of the edited stream is possible at a later time. 

10 The internal memory for carrying out the edit step is comprised in the block 8 

of the apparatus of figure 1. 

Generally stated, what is proposed here, is to load blocks of information around 
the edit points of both stream in the internal memory of the apparatus. Assume the memory is 
128 Mbits (16 Mbyte) and assume that during editing no other functions are active in the 

15 apparatus, then the full 16 Mbyte can be used to load a block of information of a size of e.g. 8 
Mbyte that includes the exit point and block of information of eg. 8 Mbyte that includes the 
entry point. 

The editor can, if necessary, first indicate an approximate position for both the 
OUT and IN point by pressing a button while watching the original streams. Then part of the 

20 first information block (with the OUT point) should be (or remain) loaded in the internal 

memory but loading sufficient information after the OUT point also in the internal memory. 
Next part of the second information block should be (or remain) loaded in the internal 
memory, preferably including sufficient information before the IN point also in memory. In 
this way the editor can "refine the IN and OUT points" without having to reload new 

25 information of the disc into memory. 

Having 16 Mbytes available at 10 Mbps peak bit rate , and allowing for an 
overlap in time of 2 seconds of both signal blocks, a total resulting playing time from memory 
can be achieved of 14 seconds. 

A further aspect of the invention, is the generation of the bridging fragment 'in 

30 the background', after having inputted the 'out' and 'in' positions a and b respectively, see 
figure 5, for a first edit point. As a result, after having inputted the 'out' and 'in' positions for 
the first editing point, the user can start finding the exact positions of the next 'out' and 'in' 
positions for the next edit point, whilst the system generates the bridging fragment for the first 
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edit point 'in the background'. In this way, time required for editing can be decreased, by 
doing tasks in parallel in the foreground and the background. 

With the invention, seamless playback is possible using only one MPEG 

decoder. 

5 Whilst the invention has been described with reference to preferred 

embodiments thereof, it is to be understood that these are not limitative examples. Thus, 
various modifications may become apparent to those skilled in the art, without departing from 
the scope of the invention, as defined by the claims. Further, the invention lies in each and 
every novel feature or combination of features. 
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CLAIMS: 



11 
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1. Method of editing a first and a second digital video information signal in an edit 

apparatus, where the second video information signal may be the same video information 
signal as the first video information signal, the first and second digital video information 
signal being recorded on a record carrier, such as an optical disc, the method comprising the 
5 steps of 

(a) reading a first block of information of the first digital information signal that is located 
around an edit point to be determined in the first digital information signal from the record 
carrier into an internal memory of the apparatus, 

(b) outputting the first block of information from the apparatus, for display, 

10 (c) establishing an 'out' position in the first block of information as the edit point in the first 
digital video information signal, 

(d) reading a second block of information of the second digital video information signal that is 
located around an edit point to be determined in the second digital video information signal 
from the record carrier into the internal memory of the apparatus, 
15 (e) outputting the second block of information of the second digital video information signal 
from the apparatus, for display, 

(f) establishing an 'in' position in the second block of information as the edit point in the 
second digital video information signal, 

(g) processing a portion of the first block of information that precedes and may include the 
20 'out' position, and a portion of the second block of information that follows and may include 

the 'in' position into a composite block of information, 

(h) outputting the composite block of information from the apparatus, for display, prior to 

(i) recording at least a portion of the composite block of information on the record carrier. 



25 



2 - Method as claimed in claim 1, wherein the step (h) further includes the substep 

of manually inputting a recording control signal after the outputting of the composite block of 
information for display, 
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the step (i) comprising the step of recording the at least a portion of the composite block of 
information stored in the internal memory onto the record carrier, in response to the recording 
control signal. 

5 3. Method as claimed in claim 1, wherein the step (h) further includes the substep 

of manually inputting a reject control signal after the outputting of the composite block of 
information for display, the method further comprising the step of repeating at least the steps 
(c), (f) (g) and (h) in response to the reject control signal. 

10 4. Method as claimed in anyone of the preceding claims, wherein the step (g) 

includes the substeps of 

(gl) determining an exit point earlier in the first block of information than the 'out' position, 
(g2) determining an entry point later in the second block of information than the 'in' position, 
(g3) creating a bridging block of information from the information in the first block of 
15 information between the exit point and the 'out' position and from the information in the 

second block of information between the 'in' position and the entry point, the composite block 
of information comprising a portion of the first block of information that directly precedes the 
exit point, the bridging block of information and a portion of the second block of information 
that directly follows the entry point. 

20 

5. Method as claimed in claim 4, where the step (i) comprises recording the 
bridging block of information on the record carrier. 

6. Method as claimed in anyone of the preceding claims, wherein, after having 
25 inputted the 'out' and 'in' position for an edit point, the bridging block of information is 

generated in the background, whilst in parallel, the user is capable of determining the 'out' and 
'in' position of a next edit point. 
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7. Edit apparatus for carrying out the method as claimed in anyone of the 

preceding claims. 
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